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DETAILED ACTION 
Response to Amendment 

1 . Applicants' amendment filed December 1 , 2003, has been entered and made of 
record. 

2. Applicants' arguments filed December 1 , 2003 have been fully considered but 
they are not persuasive. 

Applicants argue in essence that DeTitta (Prior art of record) does not Claim the 
plate imaging system described in Column 10, therefore, it can not be presumed that 
the description of the plate imaging system is adequate to enable one of ordinary skill in 
the art would be able to make and use the plate imaging system disclosed in DeTitta. 

The Examiner disagrees and indicates that DeTitta et al invention (U.S. Patent 
6,368,402) in its entirety is the basis for rejection, whether a part of the disclosure is 
Claimed or not. Some of the concepts in the disclosure of a patent application may be 
claimed in later date in a continuation to the instant application if applicants desire. The 
successful design and reduction to practice of the plate imaging system is the evidence 
for its enablement. 

Claim Rejections - 35 USC § 102 

3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or 
in public use or on sale in this country, more than one year prior to the date of application for 
patent in the United States. 
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4. Claims 1, 2, 5, 6, 10, 13, 14, 17, 18, 22, 30, 31, 34, 35, and 39 are rejected under 
35 U. S. C. 102(b) as being clearly anticipated by DeTitta et al. (hereinafter DeTitta), 
U.S. 6,368,402. 

As per Claim 1 , DeTitta teaches: 

A) at least one camera, (Column 10, Lines 41-42); 

B) an indexing device ("custom built travel image stand", Column 10, Lines 38-41 
and Daedal XY Precision with 4 axis indexing card, Column 10, Lines 47-50) for 
sequentially placing said microscopic crystals in camera view of said at least one 
camera (Column 10, Lines 42-43); and 

C) at least one computer (Figure 9) programmed to control said indexing device 
and said at least one camera, wherein said at least one computer is programmed 
(Column 10, Lines 63-65) to receive from said at least one camera images (Column 11, 
Lines 7-9) of said plurality of microscopic crystals, wherein said at least one computer is 
programmed to classify (encoded zero or one, Column 11, Lines 14-23) said plurality of 
microscopic crystals. 

As per Claim 2, DeTitta teaches: a computer monitor (Column 10, Line 67- 
Column 11, Line 3, Figure 9 , element 36), wherein an operator interfacing with said at 
least one computer manually inputs a score (a "1" or "0", Column 14-17) to classify said 
plurality of microscopic crystals after observing said plurality of microscopic crystals on 
said computer monitor. As per Claim 5, DeTitta teaches: wherein each of said plurality 
of microscopic crystals are contained within a drop of liquid (Column 9, Lines 52-57), 
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wherein each drop of liquid is contained within a well of a micro-well plate (Column 10, 
Lines 2-3, see Figures 1-4 ;). 

As per Claim 6, DeTitta teaches: 

wherein said plurality of microscopic crystals are a plurality of protein crystals 
inside the wells of at least one micro-well plate (Column 1 1 , Lines 8-1 0, see Figure 8). 
As per Claim 10, DeTitta teaches: 

a frame grabber for receiving images of said plurality of microscopic crystals from 
said at least one camera (Column 10, Lines 52-53). 
As per Claim 13, DeTitta teaches: 

A) sequentially placing said plurality of microscopic crystals in camera-view 
(Column 10, Lines 42-43) of at least one camera utilizing an indexing device (Daedal X- 
Y Precision with 4 axis indexing card, Column 10, Lines 47-50); 

B) taking the images of said plurality of microscopic crystals with said at least 
one camera (video system records individual wells, Column 10, Lines 42-43 and feeds 
into a framegrabber, Column 10, Lines 51-53), 

C) transferring said images to at least one computer (the images are recoded 
and saved to a file, Column 10, Lines 53-58), 

D) receiving said images at said at least one computer (Column 10, Line 67- 

Column 11, Lines 3), and 

E) classifying said images at said at least one computer (Column 1 1 , Lines 8-17), 
wherein said at least one computer is programmed to control said at least one indexing 
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device and said at least one camera (the table motion and image capturing; is computer 
controlled, Column 10, Lines 52-55). 

As per Claim 14, DeTitta teaches: 

wherein said step of classifying said images at said at least one computer is 
done manually, wherein an operator interfacing with said at least one computer and 
viewing a computer monitor (Column 11, II. 8-11) manually inputs into said at least one 
computer a score (" 1" or "0", Column 1 1 , Lines 14-15) to classify said plurality of 
microscopic crystals after observing said plurality of microscopic crystals on said 
computer monitor. 

As per Claims 17, 18, and 22, these Claims recite substantially the same 
limitations as Claims 5, 6, and 10 above and analogous remarks apply. 

As per Claims 30, 31, 34, 35, and 39, they recite substantially the same 
limitations as Claims 1, 2, 5, 6, and 10, above and analogous remarks apply. 

Claim Rejections - 35 USC ,§ 103 
5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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6. Claims 3, 15, 28, 29, 32, 42 and 43 are rejected under 35 U. S. C. 103 (a) as 
being unpatentable over DeTitta as applied to Claim 1,13, and 30 above, and further in 
view of Hartley et al., (hereinafter Hartley), U.S. 5,544,254. 

As per Claims 3, 15 and 32, DeTitta teaches that the computer presents the 
views to a user to classify; DeTitta does not specifically teach automatic classification. 
However, Hartley teaches: 

wherein said at least one computer automatically classifies said plurality of 
microscopic crystals after receiving said images (Column 6, Lines 10-17, 36-43). 

It would have been obvious to one of ordinary skill in the art to use the automatic 
classification system of Hartley in the system of DeTitta to eliminate human intervention 
in order to cope with the high-throughput of the robotic setup. Use of the automatic 
classification feature would clearly increase system speed and efficiency once 
optimized and provides data that may be used to alter the operating parameters of the 
crystal production process (Hartley, Column 6, Lines 3740). One of ordinary skill in the 
art would be motivated to look to Hartley to see how others have classified crystals 
using image processing techniques. 

As per Claim 28, DeTitta does not specifically teach comparing images to images 
stored in the database, although he does teach comparing collected image data to data 
stored in the a database (comparison of precipitation scores, Column 1 1 , Lines 26-50). 
However, Hartley teaches: step of classifying said images at said at least one computer 
comprises the sub steps of: 
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A) comparing said images (Column 2, Lines 8-10) to a database (Column 2, 
Lines 10-12) stored on said at least one computer (Column 5, Lines 23-27), and 

B) assigning a classification based on said comparison (Column 6, Lines 10-17, 
36-43). 

As per Claim 29, DeTitta teaches: 

A) making a determination as to whether a microscopic crystal exists (a "1 ", 

Column 11, Line 15), 

B) making a choice from a list of predetermined description as to what is present 
if said microscopic crystal does not exist, and (a "0", Column 1 1 , Line 14; Column 1 1 , 
Lines 19-23). However, DeTitta does not specifically teach a determination of quality 
although Hartley does teach such a feature. 

C) making a determination as to the qualities of said microscopic crystal if said 
microscopic crystal does exist (Figures 5-8; Column 3, Lines 35-58). 

With regards to Claims 42 and 43, arguments analogous to those presented for 
Claims 13, 28 and 29 are applicable to Claims 42 and 43. 

7. Claims 4, 16, and 33 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over DeTitta, Harris and Update as applied to Claims 7, 19, and 36 above, and further in 
view of Reimer et al., (hereinafter Reimer), U.S. 6,061,086. 

As per Claim 4, DeTitta does not specifically teach the use of two cameras, 
However, Reimer teaches: 

wherein said at least one camera is a first camera and a second camera, wherein 
said first camera is set at a constant zoom to cover a large field of view (Figure 3, 



Application/Control Number: 09/982,048 Page 8 

Art Unit: 2623 

element 20, Column 6,Lines 6163, wherein said second camera comprises a motorized 
zoom lens controllable (Figure 3, element 30, Column 6, Lines 63-66) by said at least 
one computer (Column 7, Lines 20-28). 

It would have been obvious to one of ordinary skill in the art to eliminate the data 
volume while still maintaining the processing capability equivalent to the human visual 
system, which provides the greatest accuracy in classifying image objects as defective 
(Reimer, Column 3, Lines 3355). 

8. Claims 7, 19, and 36 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over DeTitta as applied to Claims 1, 13 and 30 above, and further in view of Harris et 
al., (hereinafter Han-is), U.S. 6,388,788 B 1 and Automation Update (hereinafter 
Update), "Open for Inspection: Parker Daedal's New Positioner designed for Inspection 
Applications", Jan. 1998,www.textronics.com/ 
Newsletters/arch ivedarticles/1 998/01 98newsletter.pdf 

As per Claims 7, 19, and 36, DeTitta teaches: 

wherein said indexing device comprises: 

A. a first linear actuator for horizontally positioning said positioning station 
(Daedal X-Y Precision, Column 10, Lines 48-53), Update teaches that the X-Y Precision 
can accept microscopes and other machine vision inspection equipment. DeTitta nor 
Update specifically teach being able to move in a vertical axis, although DeTitta does 
teach that the plate glass and framework are controlled by a 4 axis indexing card. Four 
(4) axes to the examiner indicates movement in the X, Y, and Z axes. However Harris 
teaches: 
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B. a second linear actuator for horizontally positioning said at least one camera 
(cot. 15, II. 3-5, although Harris teaches an XY controller moves the 96 well (microtiter) 
plate, it would have been obvious to one of ordinary skill in the art that the camera could 
be moved instead of the well plate), and 

C. a third linear actuator for vertically positioning said at least one camera (cot. 
14, Line 66). 

It would have been obvious to one of ordinary skill in the art to use the 
suggestions of Update, which more thoroughly describes the custom capabilities of the 
Daedal X-Y Precision table disclosed in DeTitta, and those features disclosed in Harris 
to incorporate obvious camera manipulation apparatus into the custom built table and 
indexing device disclosed in DeTitta to provide the most cost effective by using 
commercial-of-the-shelf available parts and time efficient to keep up with the high 
throughput requirements of DeTitta (abstract) to build an indexing device. One of 
ordinary skill would be Motivated to use the above prior art systems particularly since 
Harris is directed towards imaging a 96 well plate as is DeTitta. 
9. Claims 8, 20 and 37 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over DeTitta, Harris and Update as applied to Claims 7, 19, and 36 above, and further in 
view of Reimer et al., (hereinafter Reimer), U.S. 6,061 ,086. 

As per Claims 8, 20 and 37, DeTitta nor Update teach using two cameras. Harris 
teaches using two cameras (Column 16, Lines 53-56), but does not teach one camera 
having a constant zoom and the other having a motorized zoom. Although Harris does 
teach a motorized zoom (Column 14, Line 66). However, Reimer teaches: 
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wherein said at least one camera is a first camera and a second camera, wherein said 
first camera is set at a constant zoom to cover a large field of view (Figure 3, element 
20, Column 6, Lines 6263), wherein said second camera comprises a motorized zoom 
lens (Column 6, Line 63-. Column 7, Line 1) controllable by said at least one computer 
(Column 7, Lines 20-29). 

It would have been obvious to one of ordinary skill in the art to use the two 
camera feature of Reimer in the system of DeTitta, Update and Harris, to provide 
accuracy in finding the well locations by allowing the wide field of view camera image to 
be scanned to locate target (wells) images, particularly since both DeTitta and Harris 
are directed towards locating well positions and performing high speed classification. 
10. Claims 9, 11, 12, 21, 23, 24, 38, 40, and 41 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over DeTitta as applied to Claims 1,13, and 30 above, and 
further in view of Inokuchi, U.S. 6,259,960 B1 . 

As per Claims 9, 21, and 38, DeTitta discloses that the user can name a plate 
manually, but does not specifically state that a barcode is used. Nor does DeTitta teach 
a plate sensing device. However, Inokuchi teaches: 

comprising a bar-code reader (Column 7,Lines 36-40 and Column 18, Lines 39- 
41) and a micro-well plate sensing device (part moving means moves the part to be 
inspected into the target coordinate region, Column 7, Lines 60-65, or alternatively, the 
state coordinate system is adjusted based upon the imaged x-y difference between the 
target coordinates and the state coordinates, Column 8, II. 23-39). 
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It would have been obvious to one of ordinary skill in the art to use Inokuchi's 
automated bar-code reader to input the information regarding the plate instead of 
manually inputting that data into the computer which may result in mistaken information. 
Also, Inokuchi teaches that it is well known to have position sensing capabilities in 
inspection devices, which facilitates automated inspection because precise placement 
of the target plate is not a true concern. One of ordinary skill in the art would have been 
motivated to look at the inspection device of Inokuchi because it is directed towards 
automatic image processing of microscopic images for certain features to be found in 
the image. Inokuchi also has a manual inspection mode as well as an automatic 
inspection mode. 

As per Claims 11 , 23, and 40, although DeTitta teaches that his inspection 
system is used on a computer, he does not specifically teach that is part of a network. 
Inokuchi is directed to a material-inspection and classification apparatus (Column 17, 
Lines 18-21, 24-26). However, as per Claims 11, 23, and 40, Inokuchi teaches: 
wherein said at least one computer is connected to a computer network. (Figure 1 , 
Column 16, II. 60-65). 

It would have been obvious to one of ordinary skill in the art to use the 
networking suggestion of Inokuchi in the inspection and classification system of DeTitta 
to facilitate management of classification information at a central location thereby 
making it unnecessary to save and download classification data from individual plate 
imaging stations of DeTitta (Inokuchi, Column 17, Lines 43-50). 

As per Claims 12, 24, and 41, Inokuchi teaches: 



Application/Control Number: 09/982,048 Page 12 

Art Unit: 2623 

wherein said at least one computer network is the Ethernet. (Column 16, Line 65). 
1 1 . Claims 25 and 26 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over DeTitta as applied to Claims 13 above, and further in view of Bacus et al., 
(hereinafter Bacus), US 6226392 Bl. 

As per Claim 25, DeTitta does not specifically teach color images are obtained of 
the crystals. However, Bacus teaches: 

wherein said images of said plurality of microscopic crystals are color images. 
(Column 8, Lines 56-58) 

It would have been obvious to one of ordinary skill in the art to use the color filter 
wheel of Bacus with the imaging sensor of DeTitta to provide color images that will allow 
for more accurate classification of crystals when classification may be based upon the 
certain colors in the crystals. Furthermore, Bacus teaches that color images have been 
well known in inspection systems for a number of years. 

As per Claim 26, Bacus teaches: 

A) viewing each of said plurality of microscopic crystals through a first linear 
polarized filter (Figure 413, elements 172 or 170) and a second colored filter (Figure 
413, element 180), wherein the color of said second colored filter is altered between 
red, green and blue (Column 8, Lines 57-58), to obtain a first image, a second image 
and a third image, and 

B) combining said first image, said second image and said third image to obtain 
said true colored images (Column 8, Lines 59-62). 
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12. Claim 27 is rejected under 35 U.S.C. 103(a) as being unpatentable over DeTitta 
and Bacus as applied to Claims 13 above, and further in view of Glazer et al 
(hereinafter Glazer), UK 231 0925. 

As per Claim 27, Bacus does not specifically teach using false colors. However, 
Galzer teaches: 

steps of viewing each of said plurality of microscopic crystals through a first linear 
polarized filter (Figure 1 , element 15) and a second linear polarized filter (Figure 1 , 
element 14) to obtain said false color images (p. 2, second paragraph). 

It would have been obvious to one of ordinary skill in the art to use the false 
colors of Glazer in the color crystal images of DeTitta and Bacus to measure the 
refractive indices of a crystal which by using false colors allow for indications or 
measures across the sample for its optical anisotropy, which provides additional data to 
further classify any crystal material and take advantage of the image processing 
inspection system. 

Conclusion 

1 3. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 

§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
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mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Contact Information 
14. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Mehrdad Dastouri whose telephone number is (703) 
305-2438. The examiner can normally be reached on Monday to Friday from 8:00 a.m. 
to 4:30 p.m.. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Amelia Au can be reached on (703) 308-6604. The fax phone number for 
the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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